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Abstract 

We consider synchronization of weighted networks, possibly with asym- 
metrical connections. We show that the synchronizability of the networks 
cannot be directly inferred from their statistical properties. Small local 
changes in the network structure can sensitively affect the eigenvalues rel- 
evant for synchronization, while the gross statistical network properties 
remain essentially unchanged. Consequently, commonly used statistical 
properties, including the degree distribution, degree homogeneity, average 
degree, average distance, degree correlation, and clustering coefficient, can 
fail to characterize the synchronizability of networks. 
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1 Introduction 

The description and classification of complex networks are often based on their 
statistical properties, such as the degree distribution, average degree, average 
distance, clustering coefficient, and degree correlations, among others [1-3]. In- 
deed, the starting point for the recent explosion of interest in complex networks 
can be traced to the observation that real networks have degree distributions 
that are much different from those of classical random graphs [4]. On the other 
hand, the dynamics of processes defined on networks are intimately related to 
the spectrum of an appropriate connection operator. A prototypical example is 
chaos synchronization [5], which crucially depends on the extremal eigenvalues 
of the graph Laplacian [6-8]. This raises the natural question of if and how the 
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statistical properties of a network are related to its spectral properties. Many 
recent papers have investigated various facets of this relation. For example, some 
papers have reported correlations between network synchronizability and degree 
homogeneity [9-11], clustering coefficient [12], degree correlations [13], average 
degree, degree distribution, and so on [14]. In some cases the observed corre- 
lations can point in opposite directions; for instance, [9] finds that increasing 
the degree homogeneity improves synchronizability, whereas [14] and [13] report 
cases of better synchronizability for decreased homogeneity. Similarly, adding a 
few shortcut links to a sparse lattice is known to decrease the characteristic path 
length and improve synchronizability at the same time [15,16], although another 
study showed that better synchronization can result despite increased average 
distance [9]. Clearly, in view of the multitude of graph characteristics, it can be 
difficult to translate the numerically observed correlations into causal relations. 
Rigorous mathematical methods are important for investigating the relations 
between different network properties. The present paper provides a step in this 
direction. We give a mathematical argument which shows that many statistical 
network properties do not suffice to determine synchronizability. We present ex- 
amples showing that networks with the same statistical properties can have very 
different synchronization characteristics. The results establish that the spectral 
properties of networks are not simply derivable from statistical properties, and 
should therefore hold their own place within the list of intrinsic network features. 

2 Spectral properties and structure 

Consider a network of n nodes (vertices), with links (edges) between certain 
pairs of nodes, which may additionally carry weights indicating the strength of 
the relation they represent. We use the nonnegative numbers Uij to denote the 
weight on the link from the jth node to the ith node, where Uij = if and only if 
there is no link from j to i. In general Uij ^ aji, although symmetric connections 
arise naturally in many common models. The degree of the vertex i is defined 
as deg(i) = Ylj^v ^v- Unweighted networks appear as a special case where each 
link carries a weight of 1 — in this case A = [ojj] is the usual adjacency matrix, 
and the degree of a vertex is the number of its neighbors. 

The Laplacian matrix is defined by L = D—A, where D denotes the diagonal 
matrix of vertex degrees. In case A is symmetric, the Laplacian is a symmetric 
and positive semidefinite matrix. Therefore, it has real and nonnegative eigen- 
values, which we order as Ai < A2 < • • • < (counting multiplicities) , and an 
orthogonal set of eigenvectors {ui, . . . , u„} which form a basis for M". Since the 
row sums of L are zero, the smallest eigenvalue Ai is always zero, and the corre- 
sponding eigenvector is 1 = (1, 1, ... , 1). The multiplicity of the zero eigenvalue 
equals the number of connected components of the network. In particular, the 
second eigenvalue A2 is nonzero if and only if the network is connected, which 
is one of the most fundamental relations between the network structure and the 
spectrum of the connection operator. 

For undirected networks, simple bounds can be given for the eigenvalues in 
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terms of the vertex degrees, which provide further insight into the relation be- 
tween the structural and spectral properties. Let dmin and dmax denote, respec- 
tively, the smallest and the largest degree, and let Amax be the largest eigenvalue 
of the Laplacian. Then the following estimates are well-known (e.g. [17]): 

Tl 71 

-^2 ^ r^inin — r'^max ^ ^uiax ^ 2(iniax' (1) 

n — 1 n — 1 

Similarly, in terms of the average degree davg it can be shown that 

"avg < ^max 1 (2) 

see e.g. [18]. Note that the second eigenvalue does not have a simple bound from 
below in terms of the vertex degrees. This observation will be important later 
on, as we show that A2 can indeed be arbitrarily small among a class of networks 
having the same vertex degrees. 



3 Spectral properties and synchronization 

The nodes of a network are often dynamical systems evolving according to certain 
rules, and the links represent their pairwise interaction. A typical interaction 
type is diffusion, which forms the prototypical example where synchronization is 
observed [19], and naturally gives rise to the Laplacian operator L. It is thus no 
coincidence that the dynamical properties are closely related to the structural 
properties of the network. To focus on a well-known example, we consider the 
case of the so-called coupled map lattice [20] 

n 

x,{t + 1) = f{xi{t)) + ^ a,, [f{x,{t)) - fixiim (3) 

which we have written in a slightly more general form by allowing individual 
weights aij > along the links instead of a common coupling strength for the 
whole network. Denoting x = (xi, . . . , Xn) and -F(x) = (/(xi), . . . , f{xn)), the 
system ([3]) can be written in vector form 

x(t + l) = (/-L)F(x(t)). (4) 

The network ([3]) is said to synchronize if limt^oo \xi{t) — Xj{t)\ = for all i,j 
whenever the initial conditions belong to some appropriate open se10. In this 
case, the system asymptotically approaches a synchronous state, where each 
node exhibits the same time evolution, Xi{t) = s{t) for all i, or x(i) = ls{t). It 
follows from ([3]) that s{t + 1) = f(s{t)); i.e., the behavior of the nodes in the 
synchronous state is identical to their behavior in isolatiorH. In this paper we 

^For chaotic synchronization there are some subtleties regarding the nature of the attraction 
and the open set of initial conditions; the interested reader is referred to [21] for a clarification 
of such issues. The details, however, will not be important for the derivation presented here. 

^Here we neglect any coupling delays in the network. The synchronous solutions can be 
markedly different when delays are introduced; see [22,23]. 
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focus on chaotic synchronization, that is, the case when / has a compact chaotic 
attractor A and s represents some dense (and necessarily unstable) orbit in A. 
Assuming that / is continuously differentiable, small perturbations u about the 
solution s{t) are governed by the equation u{t + 1) = f'{s{t))u{t), which has the 
solution 

t-1 

u{t)=u{0)l[f'{s{k)). 

k=0 

Hence, the condition for local asymptotic stability of s{t) is that 

hm ni/'(Kfc))| = 0. (5) 

t— >oo -•- -•- 

A:=0 

While ([5]) would not hold for any solution s inside a chaotic attractor, it is always 
possible to find some sufficiently large number a such that 

t-1 

lunl[e-"\f'{s{k))\=0. (6) 

k=0 

In fact, it is easy to see that ([6]) holds for all a satisfying 

1 

a>/.^ lim-j;iog|/'(s(A;))|; (7) 

k=0 

where n denotes the Lyapunov exponent. 

Synchronization of coupled map lattices has been studied in more or less 
general forms; e.g., [7,19,24]. To find the corresponding conditions, one considers 
small perturbations u(t) = x(t) — ls{t), which are governed by the variational 
equation 

n{t + l) = f'{smi-L)u{t). 

Assuming that the eigenvectors of L form a basis for M"', the perturbations 
can be taken along an eigenvector of L, u(t) = pi(t)ui, where i > 2 since 
the perturbations along the direction 1 still yield a synchronous solution. The 
amplitude Pi{t) along the ith eigenvector obeys 

t 

m{t + 1) = f'ismi - xMt) = pm n f'{s{k)){i - A,). 

fc=0 

Thus, the system synchronizes if 

t-1 

hm n |/'(s(fc))||l-Ai| =0, i = 2,...,n. (8) 

fc=0 

In view of © and ([7]), a sufficient condition for local synchronization is 

max{|l-Ai| :i = 2, ...,n} <e~''. (9) 
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The significance of the simple condition ([9]) is twofold. Firstly, it separates 
the effects of the local (isolated) dynamics given by /j, from the effects of the 
network structure given by the left-hand side. Therofore, an appropriate syn- 
chronizability measure for the network is 

cj = max{|l — Aj| : i = 2, . . . , (10) 

smaller values of a yielding synchronization for a larger class of functions /. 
Secondly, the role of the network structure on synchronizability is characterized 
by the spectrum of the Laplacian. The only assumption about L used above is 
the existence of n linearly independent eigenvectors, which is generically satisfied 
by matrices in M"^". Hence, a can be used for comparing general networks with 
respect to their synchronizability, including directed and weighted ones, and 
even when they have different sizes. 

For undirected weighted networks the synchronizability measure (llOp simpli- 
fies to 

a = max{|l - A2I, |1 - Amax|} 

where Amax = A„. Then three types of networks can be distinguished. 

(a) All eigenvalues are less than or equal to 1. In this case synchronizability is 
determined solely by A2 , a larger value implying better synchronizability through 
the condition A2 > 1 — e~^. 

(b) All eigenvalues are larger than 1. In this case synchronizability is deter- 
mined solely by Amax; a smaller value implying better synchronizability through 
the condition Amax < 1 + e~^. 

(c) A2 < 1 < A 

max- In this case synchronizability depends on both A2 and 
Amax; higher values of A2 and smaller values of Amax implying better synchro- 
nizability through the condition 

A2 

Amax ^ 1 + e-/^ 

Note that in a weighted network the eigenvalues contain information about 
the connection strengths. So, cases (a) and (b) can also be viewed as weakly 
and strongly coupled networks, respectively, whereas (c) can be thought of as the 
case of intermediate coupling strength. In this setting, the eigenratio A2/Amax 
has been used as a numerical measure of the synchronizability of networks. In 
all cases, the critical quantity here is often A2 since it can be arbitrarily small, 
whereas Amax can be bounded in terms of the largest vertex degree, as seen from 

©• 

4 Structural limitations to synchronization 

The synchronizability of the network is directly related to the its spectral prop- 
erties by ([9]). Can the same be said about the statistical properties? We shall 
show that the answer is negative in general, although in certain cases some useful 
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information about synchronizability can be obtained. Throughout this section 
we deal with undirected networks. 
Using ([T]), it is seen that 

< (11) 
'^max '^max 

Therefore, a network whose smahest and largest degrees are very different is 
a bad synchronizer. For example, scale-free networks have poorer synchroniz- 
ability in comparison to some other architectures, as observed in [25]. Note, 
however, that pip does not imply that a more homogeneous degree distribution 
always means better synchronizability. (In fact, we later give examples where 
a higher degree homogeneity results in worse synchronizability.) For one thing, 
(jlip is only an upper bound for the eigenratio. Moreover, the bound depends on 
the extreme degrees, whereas degree homogeneity (defined as the standard devi- 
ation of the degree distribution) is an average quantity, which may only loosely 
depend on the extreme degrees in large networks. In the following, we will use 
more sophisticated bounds on A2 and derive general structural limitations on 
synchronization. We will show that the effect of small structural changes on 
synchronization need not average out within the large network structure, and 
therefore may not be captured by the average network properties. 

For notation, let V denote the set of vertices of an undirected network G, 
and let 5 C y be a subset of vertices, with V — S denoting its complement, and 
IS* I its cardinality. Define 

\dS\=Yl E 

ies j&v-s 

In words, \dS\ is the (weighted) number of edges between S and its complement. 
The isoperimetric number i{G) of a graph G is defined by 

i(G)=min|M:5cy, 0<|5|<^}. (12) 

The computation of i{G) is an NP-hard problem [26]. However, an important 
result in graph theory gives a lower bound for the isoperimetric number in terms 
of the second eigenvalue of the Laplacian, namely, i{G) > ^A2. We turn the 
table around, and use this result and (fT2]) to estimate A2 as 



where S is any subset of vertices satisfying < |5| < n/2. 

The estimate ()13p holds the key to understanding why the statistical prop- 
erties of the network can fail to determine A2. The important observation is 
that the bound on A2 is determined by the properties of some subgraph S and 
not in general by the graph itself. In particular, S can be very small compared 
to the whole graph, in which case the statistical properties of the graph need 
not be reflected in S, although the latter plays a crucial role in constraining 
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Figure 1: The statistical properties of the graph G is determined by the huge 
part H, while the value of A2 is independently constrained by the small subgraph 
S. 

the value of A2- Figure [T] illustrates the idea in intuitive terms. Suppose in the 
graph G we identify a huge part H and a much smaller part S. (Alternatively, 
we can imagine the possibility of appending a small set of nodes S to an exist- 
ing graph, which is a realistic scenario if one considers time- varying connections 
which might come on and off [21,27,28]). By (jl3p . the value of A2 is constrained 
by the properties of S. However, all the gross statistical properties of G are 
determined by H. If H is any graph which is claimed to have good synchroniz- 
ability, we can force G to have poor synchronizability by appending S to H. In 
other words, for large networks, the synchronizability of G and H can be very 
different, although many of their statistical properties are essentially the same. 
For instance, if S consists of 20 nodes and is connected to H by one link, then 
by A2 < 0.1 regardless of how H is chosen. Furthermore, A2/Amax can be 
considerably smaller, especially if the average degree is high (viz. ([2])), which 
shows that a large average degree can actually impede synchronizability. This 
example also illustrates the phenomenon observed in [18]; namely, when two net- 
works are combined by adding some links between them, the synchronizability 
of the overall network decreases as the synchronizability of individual networks 
is increased. 

We have established that it is the local structures, described by the sets S, 
that constrain the synchronizability, regardless of the global properties of the 
network. Such local structures are conspicuous in certain types of networks 
while they may not be so obvious in others. For example, the situation shown 
in Figure [1] is typical for traffic or transportation networks, where traffic is 
much denser within cities than between them, and for interacting brain areas, 
where intracortical connectivity is higher than inter-areal connections. We note, 
however, that such local structural constraints need not exist in every network. 
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Figure 2: Link switching: The Hnks uv and xy are deleted, and new Hnks ux 
and vy are added. The vertex degrees remain unchanged after the operation. 



For instance, if the minimum degree is much larger than n/2, then the ratio 
ISSI/IS"! will be large for any subset S satisfying l^l < n/2. However, such 
networks are very densely connected (the total number of links being at least 
which is about one half of that of a complete graph), whereas most real- 
world networks are much sparser. Hence, if one considers networks which are not 
too densely connected, it turns out that within essentially any family of graphs 
having the same degree distribution, there exist graphs containing subsets S for 
which |(9S'|/|S'| is small, and so the graph has a small second eigenvalue A2. For 
a detailed mathematical proof the reader is referred to [29]. 

Without going into technical details, we here illustrate the essential ideas to 
show that networks with the same degree distribution can have very different 
synchronizability. A useful notion for this purpose is the use of link switching 
to vary network properties without altering the vertex degrees [30]. As depicted 
in Figure O link switching refers to the operation where, given two pairs of 
neighboring nodes u, v and x, y, one breaks the links uv and xy and replaces 
them by the links ux and vy. The operation leaves the vertex degrees unchanged. 
As in the particular case of Figure El the resulting network can be disconnected, 
i.e. A2 becomes zero after the switch. Another possibility is to link u to y and 
V to X, which keeps the network connected. It follows that A2 can be changed 
by link switching, which makes it clear that the degree distribution does not 
determine A2. 

As an example, we consider a circularly arranged set of nodes where each 
node is connected to its k nearest neighbors on each side (Figure Ej). Such 
circular structures have been heavily used in numerical studies of the small- 
world effect, instigated by [31]. We start with 200 nodes, where each node is 
connected to its 5 nearest neighbors on each side, and randomly switch pairs 
of links so that the degree of each node remains the sam^. It is seen from 
Figure H] that after only a few switches the eigenratio increases by more than a 

^The construction is similar to that in [15], which adds random links to a circular arrange- 
ment of nodes, whereas here we use link switching to keep the vertex degrees unchanged. 
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factor of 10. In other words, the circularly arranged network has very different 
synchronizability characteristics than a typical regular networl<0, and leads to 
an underestimation of the synchronizability for the latter. In fact, randomly 
constructed large regular networks are typically expanders (see Section [5|), i.e., 
their eigenvalues A2 can be bounded from below by a positive number. 

We next give a concrete construction for obtaining very good and very bad 
synchronizing networks having identical vertex degrees. Consider regular net- 
works of n = 2m nodes where each node has degree m — We separate the 
nodes into two groups of m elements, and distribute the m(m — 1) links in two 
different ways, as shown in FigureEl In the first graph Gi, all the links are across 
the two groups, and there are no connections within a group. In mathematical 
terms, its adjacency matrix is given by 

J -I 

where Jm denotes the m x m matrix whose every element is 1, and Im is the 
mxm identity matrix. In the second graph G2 , we start by putting all the links 
within a group, ending up with a disconnected network with two components 
(the two pentagonal shapes in Figure [5|). The corresponding adjacency matrix 
is 

J -I - 

To obtain a connected network, we use link switching to replace one link within 
each component (shown by dotted lines) with a link connecting the two com- 
ponents. In this way, for each m we construct two different graphs with the 

*A regular network is one where each vertex has the same degree. 

^The degree k of each node can also be smaller than m — 1 without changing the subsequent 
argument. However, for k > m — 1 the construction for G2 fails. Nevertheless, an average 
degree of m — 1 for 2m nodes already implies a well-connected network, the number of links 
m(m — 1) being about one half of that of a complete graph, m(2m — 1). Since real networks 
are usually much sparser than that, it suffices to consider k < m — 1. 
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Figure 4: Improvement of synchronizability by random link switches, starting 
from a circularly arranged regular network of 200 nodes with vertex degree equal 
to 10. 



same degree distribution, and having the maximum homogeneity of vertex de- 
grees, since each one is a regular network. However, these two networks have 
completely different synchronizability characteristics. Indeed, the first network 
Gi is related to the so-called complete bipartite graph. (If each vertex de- 
gree were m we would have exactly a complete bipartite graph, in which case 
X2 = m = Amax/2.) The eigenvalues for Gi are X2 = m — 2 and Amax = 2(m — 1); 
so the ratio A2/Amax increases and tends to 1/2 as m gets large. For the second 
network G2, we use (fT3]l to estimate A2/Amax < A2 < 4/m, which tends to zero 
as m gets large. Figure [6] shows the ratio A2/Amax for the two networks. It can 
be seen that a whole range (0, 0.5) of values for A2/Amax can be generated using 
only regular graphs, which include very good as well as very bad synchroniz- 
ers. Furthermore, since all these graphs have maximally homogeneous degree 
distribution, it is clear that the homogeneity of the degree distribution does not 
determine synchronizability. 

The argument above also shows that the average degree fails to determine 
synchronizability: The average degree m — 1 of both networks increases with m; 
however, this increase results in a better synchronizability for Gi and a worse 
synchronizability for G2. For a similar example which uses non-regular networks, 
see [18]. 

In closing this section, we mention that there are alternative definitions of 
the Laplacian, given by I — D^^^^AD^^^^ or I—D^^A. The foregoing arguments 
apply also to the second eigenvalue of these matrices, with the same conclusions; 
see [29]. Also for directed networks, one can use the idea of Fig. [T]to show that 
appending a small set of vertices S to an existing graph disrupts synchronizability 
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Figure 5: Two graphs with the same degree distribution and maximal degree 
homogeneity, but very different synchronizabihty. 
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Figure 6: The eigenratio for the two graphs of Figure [SJ 
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without affecting average statistical properties of the graph too much. Indeed, 
it is always possible to choose an S having as few as two vertices and containing 
no directed spanning tree. Since the resulting graph G also contains no directed 
spanning tree, it is incapable of chaotic synchronization [32]. 



5 Discussion and conclusion 

The second eigenvalue A2 of the Laplacian is an important invariant for undi- 
rected graphs. Also called the algebraic connectivity or the spectral gap, it has 
a special place within the Laplacian spectrum, and is deeply related to many 
structural graph properties. For example, it comes up in random walks on 
graphs, and consequently in epidemic spreading, as well as robustness against 
edge and vertex removal (cut problems). Hence, the result that A2 is not con- 
trolled by statistical properties of the network has significance that goes beyond 
synchronization . 

It is known from graph theory that there do not exist generally useful lower 
bounds for the eigenvalue A2. Some estimates can be obtained asymptotically 
and in a probabilistic sense, i.e., almost surely as the network size goes to infin- 
ity, and have been applied to study the asymptotic behavior of synchronizability 
in power-law networks [33]. A nice mathematical result derived in [34] for undi- 
rected random networks with given expected degrees states that 

, 4 ofn) log^ n 
max|l- Ail < (1 + 0(1)) + — (14) 

where Wavg and Wmin are the expected values of the average and minimum de- 
grees, respectively, n is the network size, and g{n) is some slow-growing function 
of n. Note that the left-hand side of (jl4p is the precisely the network synchro- 
nizability measure a defined in (jlOp . The implication is that, under conditions 
that the second term on the right is negligible compared to the first, one has 
essentially 

a<^ and ^ > ijli^. (15) 

as n ^ 00. These estimates in turn would imply that in the asymptotic limit a 
typical network with a large average degree (namely, ^Wavg at least as large as 
4e^ by ([9|)) is a good synchronizer. However, some care is needed in using (jl4p 
to derive conclusions about finite graphs. Since the o(l) term has no bounds in 
terms of graph size, it need not be small for a large but finite graph. Moreover, 
to neglect the second term on the right-hand side of (I14p . it is necessary that 
the expected minimum degree Wmm grow faster than log^ n as n ^ 00. In other 
words, (|15p can be justified only for graphs for which both the size and the 
minimum degree are very large. Unfortunately, real networks of interest are both 
finite and sparse, and as our results indicate, psp does not necessarily hold for 
these networks. In fact, ()15p is false even when we restrict ourselves to a smaller 
class of graphs by imposing additional restrictions in terms of network statistics. 
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such as fixing the degree distribution or requiring high degree homogeneity. Any 
such class would still contain a bad synchronizer with positive probability. This 
is the precise meaning of our statement that statistical properties do not suffice 
to determine synchronizability. 

Clearly, the true criteria for classifying networks with respect to synchro- 
nizability involve the Laplacian spectrum, using some measure such as ([9|lf|. A 
closely related notion in graph theory is that of expander graphs. Informally, 
these are families of sparse graphs with high connectivity, so that the isoperi- 
metric number defined by ()12p is bounded from below by some positive number. 
In this context, the isoperimetric number i{G) is also called the expansion con- 
stant. Recall that our arguments for identifying poorly-synchronizing networks 
are based on showing that i{G) can be small. Hence, in terms of the expansion 
properties of networks, our results imply that the gross statistical properties of 
networks do not suffice to characterize expander families. 

There are many factors that contribute to the difficulties of studying complex 
networks. The number of different networks of size n increases dramatically with 
n, which already makes it hard to obtain the relations between the numerous net- 
work properties based on numerical simulations alone. One might contend that 
numerical simulations give information about "typical" networks in a certain 
class, but the mathematical proof of such assertions remains an open problem. 
Moreover, the probability distributions from which networks with specific sta- 
tistical properties are drawn have rarely been specified in the literature. On 
the other hand, a more subtle question worth consideration is whether "typical" 
networks or properties carry all the information that one should be interested in. 
The question is more meaningful in the context of the complex networks found 
in nature, such as the human brain or metabolic networks, which have very dis- 
tinct functions and have evolved after a long period of time into their present 
state. It is a certainly intriguing possibility that their function may be related 
to, say, their degree distribution. However, it is hardly warranted to claim that 
the function is only a consequence of that particular distribution. Such a claim 
would imply that all networks with the same degree distribution are similar at 
the functional level, which downplays the role of the millions of years of evolution 
behind natural networks. In fact, one could argue that many natural networks 
may be necessarily "atypical" in certain sense, if evolution points along the di- 
rection of some optimization process. Hence, when considering networks with 
such unique functions, the relevant features may be those that make the network 
distinguished rather than typical, within the considered class of networks. 

In conclusion, dynamical processes on networks, and in particular synchro- 
nization, are intimately related to the eigenvalues of the coupling operator. As 
shown in the present paper, the gross statistical properties of networks do not 
generally suffice to determine the spectrum. In other words, the eigenvalues are 
among the intrinsic network features which determine the dynamics and which 
are not derivable from the statistical characteristics. Consequently, the spectral 

®It should however be kept in mind that © is a sufficient but not a necessary condition for 
synchronization of chaotic systems. 
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network properties deserve more attention in the basic description and study of 
complex networks. 
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